"The highlighted tokens are primarily Vietnamese morphemes, words, or short phrases that serve as key semantic units within sentences. They often include nouns, verbs, adjectives, and function words that are essential for conveying the main meaning, describing actions, objects, quantities, or relationships. Many are components of compound words or set expressions, and their importance is context-dependent, frequently marking the core informational content or structural elements of the sentence."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.97 | 1.0 | 0.94 | 0.969 | 0.94 | 1.0 | 0.0 | 0.06 |
fuzz | 0.92 | 0.904 | 0.94 | 0.922 | 0.94 | 0.9 | 0.1 | 0.06 |